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£S) " Abstract. We develop a technique based on Malliavin calculus ideas, for asymptotic 

expansion of dual control problems arising in connection with exponential indifference 
valuation of claims, and with minimisation of relative entropy, in incomplete mar- 
(N- kets. The problems involve optimisation of a functional in which the control features 

quadratically, while in the state dynamics it appears as a drift perturbation to Brow- 
nian paths on Wiener space. This drift is interpreted as a measure change using the 
Girsanov theorem, leading to a form of the integration by parts formula in which 
a directional derivative on Wiener space is computed. This allows for asymptotic 
(f) ■ analysis of the control problem. Applications to incomplete Ito process markets are 

given, in which indifference prices are approximated in the low risk aversion limit. We 
' , '■ also give an application to identifying the minimal entropy martingale measure as a 

Ph perturbation to the minimal martingale measure in stochastic volatility models. 

ri 

.a? 

In this article we use an approach to the Malliavin calculus, in which perturbations to 
£C) ■ Brownian paths on Wiener space are interpreted as measure changes via the Girsanov 

theorem, to derive asymptotic expansions of stochastic control problems which arise 
■ from the dual to investment and indifference pricing problems under exponential utility, 

■^j- . In the dual approach to investment and hedging problems in incomplete markets, 

^sO \ optimisation problems over trading strategies are converted to optimisations over prob- 

Q\ ■ ability measures. For example, in exponential indifference pricing of a claim with payoff 

F, we shall show (Lemma 14. 8p that the dual control representation of the time-zero 
indifference price is 



(N 



1. Introduction 



(1.1) po = sup 



E**[F] - -J 
a 



where Mj is a space of equivalent local martingale measures (ELMMs), a > is the 
risk aversion coefficient, Q° is the minimal entropy martingale measure (MEMM) and 
io(Q|Q°) is the relative entropy between any ELMM Q and Q°. In an Ito process 
setting, the optimisation over measures in (|1.1|) converts to a problem in which the 
control is a drift perturbation to a multi-dimensional Brownian motion. One views this 
drift as a perturbation to Brownian paths on Wiener space, and then Malliavin calculus 
ideas arise in deriving an asymptotic expansion for the indifference price, valid for small 
a. Similar ideas arise in entropy minimisation problems, which are the dual to pure 
investment problems with exponential utility, and we shall illustrate an example of this 
in a stochastic volatility model, in which the small parameter is 1 — p 2 , p being the 
correlation between the stock and its volatility. 
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Utility-based valuation techniques rarely lead to explicit solutions, and this motivates 
the interest in approximate solutions. The idea of using Malliavin calculus methods in 
asymptotic indifference pricing is due to Davis [7]. Davis used the approach in a two- 
dimensional constant parameter basis risk model, with a traded and non-traded asset 
following correlated geometric Brownian motions, and for a European claim depending 
only on the final value of the non-traded asset price. In this model, it also turns out that 
PDE techniques, based on a Cole-Hopf transform applied to the the Hamilton-Jacobi- 
Bellman equation of the underlying utility maximisation problem (see Zariphopoulou 
[35], Henderson [15] and Monoyios [25]), leads to a closed form non- linear expectation 
representation for the indifference price. The asymptotic expansion obtained by Davis 
[7] can therefore also be obtained by applying a Taylor expansion to the non-linear 
expectation representation, as carried out in Monoyios [MlETj. For this reason, perhaps, 
the technique developed by Davis has not been further exploited. 

In higher-dimensional models, and in almost all models with random parameters, 
the aforementioned Cole-Hopf transform does not work. Indifference prices and their 
risk-aversion asymptotics have been analysed via other methods, notably BSDE and 
BMO methods (Mania and Schweizer [23], Kallsen and Rheinlander [20] ) for bounded 
claims. Monoyios [28] derived small risk aversion valuation and hedging results via PDE 
techniques, in a random parameter basis risk model generated by incomplete information 
on asset drifts. Delbaen et al [8] and Strieker [3l] used arguments based on a Fenchel 
inequality to derive the zero risk aversion limit of the indifference price. Recently, 
Henderson and Liang [16] have used BSDE and PDE techniques to derive indifference 
price approximations, of a different nature to ours, in a multi-dimensional non-traded 
assets model. 

The techniques in this paper are different. We resurrect the method suggested by 
Davis 0. Our contribution is first to show that this technique can be significantly 
generalised, to cover multi-dimensional Ito process markets, with no Markov structure 
required, and for claims which can be quite general functionals of the paths of the 
asset prices. In doing this we elucidate the precise relation with the Malliavin calculus 
in this general set-up. The second contribution is establish a dual stochastic control 
representation (Lemma l4.8p of the indifference price process in a semi-martingale model. 
This result seems to be the most compact representation possible. We then apply the 
Malliavin asymptotic method to this control problem in an Ito process setting, and 
derive the general form of the small risk aversion asymptotic expansion of an exponential 
indifference price, recovering the well-known connection between small risk aversion 
exponential indifference valuation and quadratic risk minimisation. Examples are given 
of multi-asset basis risk models, and of stochastic correlation in basis risk. Finally, 
we show how the technique can be applied to identify the MEMM Q° = Q^; as a 
perturbation to the minimal martingale measure Qm m a stochastic volatility model, 
when the stock and volatility are highly correlated. 

Other types of asymptotic expansion for marginal utility-based prices, in terms of a 
small holding of claims, have been obtained by Kramkov and Sirbu [21] and by Kallsen et 
al [19]. These works use utility functions defined on the positive half-line, in contrast to 
the exponential utility function used throughout in this paper. In stochastic volatility 
models, Sircar and Zariphopoulou [33] obtain asymptotic expansions for exponential 
indifference prices using the fast mean-reversion property of the volatiltiy process: this 
approach has been significantly exploited in many scenarios (see Sircar et al [H]), and 
is of a different nature to our approach. 
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Malliavin calculus has found application in other areas of mathematical finance, such 
as models of insider trading [T7] , to the computation of sensitivity parameters [12] , and 
to other forms of asymptotic expansion [3], involving sensitivity with respect to initial 
conditions, or with respect to perturbations of drift and diffusion coefficients, or to a 
parameter appearing in an expectation, as opposed to a control. 

The rest of the paper is organised as follows. In Section [2] we prove a version of the 
Malliavin integration-by-parts formula on Wiener space, giving the directional deriva- 
tive of a Brownian functional. This is applied to the asymptotic analysis of a control 
problem in Section [3l in which the control is over a parametrised family Q(e) of mea- 
sures, and e is a small parameter. This leads to the main result (Theorem 13. 2p and 
illustrates the interplay between directional derivatives on Wiener space, the Malliavin 
derivative, and perturbation analysis. In Section 2] we derive, in a locally bounded semi- 
martingale model, the dual stochastic control representation of the indifference price 
process (Lemma 14. 8p that forms the basis of the control problems we are interested in. 
In Section [5] we apply the asymptotic analysis of indifference valuation in an ltd process 
setting. In Section [6] we give examples of approximate indifference valuation in some 
basis risk models, and we show how the MEMM can be identified as a perturbation to 
the minimal martingale measure in a stochastic volatility model. 

2. Directional derivatives of Brownian functionals on Wiener space 

In this section we present the underlying idea in an abstract setting. We consider 
perturbations to Brownian paths, and the ensuing directional derivatives, on Wiener 
space. This is Bismut's [5] approach to the Malliavin calculus, and will be used in 
asymptotic analysis of control problems in the next section. In this approach, one 
deduces a certain invariance principle (see (|2.6p ) by using the Girsanov theorem to 
translate a drift perturbation to a Brownian motion into a change of probability measure. 
This approach is discussed in Chapter VIII. 2 of Revuz and Yor |30j, for example. Nualart 
[29j is a general treatise on Malliavin calculus. 

The general set-up involves a Gaussian space, that is, a probability space (fi, J 7 , P) 
plus a Hilbert space H with inner product (•, and norm || • \\h- Typically, we have 
a concrete representation of H as an L 2 space: H = L 2 (T , B , n) , where (T,B) is a 
measurable space and fi is a a- finite atomless measure. Define a linear isometry W : 
H — > L 2 [(Q, J 7 , P); M] such that W = (W(h))heH is a centred Gaussian family of random 
variables with 

E[W(h)W(g)] = (h,g) H , h,g€H. 

We say that W is an isonormal Gaussian process. 

Let C p yo (M. n ) denote the set of functions / : M n — > M with derivatives of all orders of 
polynomial growth. For an isonormal process W, the set S p of smooth random variables 
consists of elements of the form 

F : =/(W(/n),...,W(/i ra )), hi € H, i = l,...,n, 

for / G C£°(R n ). 

Let L 2 [(£l, J 7 , P); H] = L 2 (f2, F, P) ® H denote the set of square-integrable H- valued 
random variables. The abstract Malliavin derivative of a random variable F £ S p , is an 
.ff -valued random variable DF S L 2 [(Q, T, P); H] that captures a notion of differentia- 
tion of F with respect to the chance parameter uj, such that (DF, h)u has properties of 
a directional derivative. 
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For F € Sp, the Malliavin derivative is defined by 

n £i 

DF := ^/(W^ 1 )' • • • ' W (M) ® 

i=l * 

This definition is not dependent on the particular concrete representation of the random 
variable F. When we use a concrete representation H = L 2 [(l~, B, /j,)] then L 2 (Q, J 7 , P) (g> 
H = L 2 [(fi x T , 7"(g>#, P<g>/z)] , and we obtain a measurable process (DtF)t£j- as Malliavin 
derivative. 

If F possesses a Malliavin derivative, we have the following well-known integration- 
by-parts formula (see Lemma 1.2.1 in Nualart |29|): 

(2.1) E[(DF,h} H ]=E[FW{h)]. 

One consequence of (JET} is that the operator D : S p C L 2 (S7, J 7 , P) -> L 2 [(0, 7", P); H] 
is closeable (see Proposition 1.2.1 in |29j). We can define the norm on S p : 

\\F\U.2 := (E[F 2 ]) 1 / 2 + (E[||DF|| 2 ,]) 1 /2, 

and denote by B 1 ' 2 the closure of D on S p with respect to this norm. The space P 1 ' 2 is 
then a Hilbert space with inner product 

(F, G)i, 2 := E[FG] + E[(DF, DG) H ]. 



2.1. The canonical example. The quintessential example of the above concepts, and 
the one used in this article, is the case of an m-dimensional Brownian motion W on the 
canonical basis (Q,F,¥ := (Ft)o<t<T, P)- Here, Q = Co([0, T]; R' m ), the Banach space of 
continuous functions w : [0, T] — > R' m null at zero, P is Wiener measure, and {Wt(uj) := 
w(t)}tg[o,T] is ^-dimensional Brownian motion with natural filtration F. The Hilbert 
space is then H = L 2 ([0, T], B([0, T]), Leb; R m ), with S([0.T]) the Borel a-algebra on 
[0, T] and Leb denoting Lebesgue measure. For brevity we write H = L 2 ([0,T];R m ). 
An element h £ H is a function ft : [0,T] -> R m , with \\h\\ 2 H = J Q T ||/i(t)|| 2 dt < oo (|| • || 
denoting the Euclidean norm), and W(/i) is the Wiener integral 



pT r-T 

W(h) := V / h\ dW~} = h t ■ dW t = (h ■ W) T . 
7~i Jo Jo 



Then E[W(/t)j = and 
E 



I*T 777, f*T 

[W(h)W(g)} = (h, g) H = h t -g t dt = J2 Kg\ dt. 

Jo „■ 1 •/ o 



'o i=1 Jo 



For ip £ H = L 2 ([0,T];W n ), introduce the Cameron-Martin subspace CM of f2 = 
Co([0, T];R m ), consisting of absolutely continuous functions $ : [0, T] — >• R m with 
square-integrable derivative </?. That is, 



t 

2 



(2.2) $ t := / <p s ds, / ||92 s || 2 ds < oo, < t < T. 

Jo Jo 

Transport the Hilbert space structure of H to CM by defining 

*) CM := {(p,ip) H = f <Pf*f>tdt, := [ 4i s ds, 
Jo Jo 
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so CM is isomorphic to H. Then, for F 6 S p and $ € CM as in (|2.2|) . the integration- 
by-parts formula (|2.ip reads as 



(2.3) E 



T 













¥?t dt 


= E 


F / ^ • dW t 






. Jo 



2.2. The Bismut approach. Bismut [5] developed an alternative formulation of the 
stochastic calculus of variations, in which the left-hand-side of (|2.3|) is a directional 
derivative on Wiener space, and the process ip is any bounded previsible process. 

Given a square-integrable functional F(W) of the Brownian paths W, that is, an 
J-^-measurable map F : — > K. satisfying 

(2.4) E[F 2 (W0] < oo, 

we would like to define a directional derivative in the direction with $ := f Q ip s ds: 

— [F(W + e$)]| £=0 := Umi[F(W + e*)-F(W)]. 

It turns out that one can make sense of the limit, resulting in a version of the integration- 
by-parts formula (|2.3p which holds regardless of whether F is Malliavin differentiable. 
We formalise this in the following lemma, which encapsulates Bismut 's approach to the 
stochastic calculus of variations. 

Lemma 2.1 (Directional derivative on Wiener space). Let F = F(W) be a square- 
integrable functional of the Brownian paths W on the Banach space O = Co([0, T];M. m ). 
Let ip be a bounded previsible process, with $ £ [] defined by <E> := j Q ip s ds. Then the 
map e — > ¥j[F(W + e<E>)] is differentiable with 

(2.5) ^ E[F(W + e$)]| £=0 = E [F(W)(tp ■ W) T ] . 

Remark 2.2. The right-hand-side of (|2.5p is E[FW(p)], which appears in the integration- 
by-parts formulae ()2.ip and (|2.3p . Hence, when F is Malliavin-differentiable and $ G 
CM C U, the object in ([23]) is also given by E[{DF, ip) H \- 

A form of Lemma 12.11 appears in Davis [7] (his Lemma 3) in a one-dimensional set- 
up, with a functional dependent only on the final value of a diffusion. Below we show 
how the Bismut approach to Malliavin calculus establishes Lemma 12.11 We give this 
argument as it is the bedrock of the asymptotic analysis of our control problem. This 
is a modified version of arguments found in some proofs of the Clark representation 
formula (see, for instance, the proof of Theorem VIII. 2. 4 in Revuz and Yor [30]). Our 
proof is more akin to the proof of Proposition 3.1 in Fournie et al [12] (but note there 
are some typographical errors in that proof). 

Proof of Lemma \2.1\ We can take tp to be previsible and, in particular, bounded, as we 
are only concerned with the direction in that (p induces, this being the direction in 
which we shall compute a directional derivative. 
For e € K, define the probability measure P e by 

dF e 

— :=£(-ecp-W) t , 0<t<T. 

By the Girsanov theorem, W e := W + e$ is Brownian motion under P e , so we have the 
invariance principle 

(2.6) Law(VF;P) = Law(VF £ ;P e ), 
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where Law(W; P) denotes the probability law of W under P. We shall use (|2.6|) shortly. 
Let E e denote expectation under P e . Since P e ~ P, we can write 



(2.7) 



E[F(W + e$)] = E C 



F(W + e$) 



dP 

dP 7 



E e 



F(W e 



dP 
dP 7 



A simple calculation establishes that 

dP 1 



£(eip ■ W £ )t- 



dP e £(ey ■ W) T 
Hence, (|2.7p becomes 

E[F{W + e$)] = E e [F(TU e )£(e<^ • W e ) T ] ■ 

Using ()2.6p . we may re-cast the right-hand-side in terms of W and expectation under P, 
to obtain 

(2.8) E[F(W + e$)] = E [F(TU)£ (e<^ • W>] . 

Using this relation we may differentiate E[.F(W + e<3>)] with respect to e at e = 0. We 
have 

(2.9) -(E[F(W + e$)-F(W)])=E 



(S(e<p-W) T -1)F(W) 



As we show below, 



(2.10) 



^{£(e<p ■ W) t -i)^(tp. W) u in L 2 , as e 0, 



for every t € [0, T]. Using this in (j2.9|) along with the square-integrability condition 
(|2.4p and the Cauchy-Schwarz inequality, we get 

1 



- (E[F(W + e$) - F(W)]) - E[F(W)(ip ■ W) T ] 



< CE 



-(£{e<p-W) T -l)-(<p-W)T 



for some constant C. The expectation converges to zero as e — > 0, and this establishes 
the lemma once we prove (|2,10p . 

To establish (|2.10p . first note that since <p is bounded, (eip ■ W) satisfies Novikov's 
criterion, and therefore £(e<p ■ W) is a martingale. Using the representation 

(2.11) £(ap ■ W) t = 1 + e / £(eip ■ W) s <p s ■ dW s , < t < T, 

Jo 

the stochastic integral is a martingale and we have 

■■I 



(2.12) 



E 



(£(eip-W) s y\\ip s \\ 2 ds 



o 



< oo, < t < T. 



Using (|2.1ip along with the ltd isometry, we have, for any t G [0, T], 

r-t 

E ' 



f {£{eip-W) s -l) 2 ds 
Jo 

By (|2.12p . the expectation on 
letting e^Owe have 



(2.13) 



limE 

e->0 



= e 2 E 


If J 

.JO Ji 


(^(e^-^) n ) 2 ||<^ n || 2 duds 
) 


right-hand-side is finite for any value of 


■W) s - 


if as 


= 0, < t < T. 
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Now, using (|2.1ip and the ltd isometry once again, we compute, for any t € [0, T], 



E 



E 



1 



€ 



(S(e<p ■ W) t -!)-(¥>■ W) t 



I {S{eyW) s -lf\\vs\\ 2 ds 
Jo 



which, using f|2. 13j) and the fact that <p is bounded, converges to zero as e — >■ 0, and this 
gives ([2TT0]) . 

□ 

Lemma 12 . 1 1 implies that 

(2.14) E[F(W + eS) - F(W) - eF(W)(ip ■ W) T ] ~ 0(e 2 ). 

The following lemma is a variant of (|2.14p . A special case of it appears in Davis [7], in 
a one-dimensional situation. 

Lemma 2.3. Given the conditions stated in Lemma [2A[ if •p = op for some fixed <p and 
c£R, then 

(2.15) E[F(W + e$) - F(W) - eF(W)(^ • W>] ~ 0(c 2 e 2 ). 
Proof. Using (|2.8p . along with the representation (|2.1ip with = tip, we have 

E [F(W + e$) - F(W) - eF{W)(ip ■ W) T ] 



e 2 c 2 E 



nw) j^J^iy t . iWt 



Using (|2.10|) and the square-integrability condition (|2.4|) as in the proof of Lemma 12. 1\ 
it is not hard to see that the expectation is finite as e — > 0, and this gives (j2.15|) . 

□ 

Of course, for c = 1, (1^151) is (|2"34"j) . 

3. Malliavin asymptotics of a control problem 

In this section we describe a control problem and analyse it via Malliavin asymptotics. 
How this type of problem arises in a financial model will be described in subsequent 
sections. 

We have a canonical basis (f2, J-, F = (J r t)o<t<r ) Q)> where Q represents some ELMM 
in an incomplete market model, and an m-dimensional Q-Brownian motion W 1 ^. A state 
variable X G M m is a functional of the Brownian paths, and follows the ltd process 

(3.1) dX t = a t dt + b t (dWf 1 + e^tdt). 

for some m-dimensional adapted process a and m x m matrix process b, satisfying 
Jq \\a-t\\ di < oo and b t b\ dt < oo, where * denotes matrix transposition. In (|3.ip . e 

is a small parameter and <p is a control process satisfying E^[J r ||y^|| 2 dt] < oo. Denote 
by $(Mj) the set of such controls (which, as will be seen in Section [51 corresponds 
to optimising over martingale measures with finite relative entropy with respect to the 
physical measure). 

It turns out that each choice of the perturbation e<p in (|3.ip yields a different martin- 
gale measure Q. Let us write Q = Q(e) to emphasise the dependence on e, so that (|3.ip 
becomes 

(3.2) dX t = a t dt + b t {dW? {e) + e<pt dt), 
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and in particular, the dynamics of X under Q(0) are therefore 
(3.3) dX t = a t dt + b t dW® {0 \ 

where 

is a Q(0)-Brownian motion. 
As will be seen in subsequent sections, the state process X is made up of d traded 
stocks S and (m — d) non-traded factors Y, 



X 



Y 



such that S is a local Q(e)-martingale, for e £ M.. Under these conditions, it turns 
out that for any integrand 9 e , defined so that the stochastic integral (6 e ■ S) is a Q(e)- 
martingale, we have the following property, which will be justified in Lemma 15. II 

Property 3.1. Let 9 e be a d- dimensional adapted process such that (6 e ■ S) is a Q(e)- 
martingale. Then for all controls <p> appearing in \3.2i) . (0 e ■ S) and ((p ■ W^ e ') are 
orthogonal Q(e) martingales. That is, we have 

(3.4) E Q ^[{6 e ■ S) T {<P ■ W Qi€) ) T } = 0. 
In particular, this property holds for e = 0. 

A square- integr able random variable F is a functional of the paths of the process X. 
Hence, under Q(e), F is a functional of the perturbed Brownian motion + e<3?, 

with $ := f tp s ds. Write F e = F(W Q ^ + e$). Under Q(e), F e will admit a Kunita- 
Watanabe decomposition of the form 

(3.5) F e = E Q W [F e ] + {6 € ■ S) T + (f ■ W Q{e) ) T , 

for adapted processes 9 e ,£ i t such that (9 e ■ S) and (£ € • W^ e ') are orthogonal Q(e)- 
martingales. In particular, this will also hold for e = 0. 
The control problem we are interested in is of the form 

r i rT 

(3.6) p:= sup 

<p£<i>(M f ) 

The idea behind the asymptotic expansion is to treat e(p as a perturbation in the dynam- 
ics (|3.2p . We suppose that, for small e, the optimal control tp will be small. Then, when 
we expand (|3.6p about e = 0, Q(0) is a measure about which the asymptotic expansion 
is based. For indifference pricing, it turns out that Q(0) = Q° = Qe, the MEMM. 
For entropy minimisation, we will have Q(0) = Qa/, the minimal martingale measure. 
Naturally, for e = the state process loses all dependence on the control (p, so in this 
case optimal control is zero, and the leading order term will be E^^fi 7,0 ]. 

Here is the main result, an asymptotic expansion of the control problem (|3.6p . 

Theorem 3.2. Let e £l be a small parameter. On the canonical basis (f2, J-, (-7 r t)te[o,T]> C 
define an m- dimensional Brownian motion W q ^. Let $t := fvipsds be such that 
E q ^[Jq \\ip t \\ 2 dt] < oo, and denote the set of such if by$(M f ). Let F e = F(W Q ^+e$) 
be a square-integrable functional of the perturbed Brownian paths + e<&, through 

dependence on the state variable X , which follows A3.2\) . The control problem with value 
function ^3. 6)) has asymptotic value given by 

rT 



p = E Q(0) [F ] + l e 2 E Q(0) f ||£0||2 dt 

2 Jo 



+ 0(e 4 



where £,° is the integrand in the Kunita-Watanabe decomposition \3. 5)) of F° for e = 0. 
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Proof. The idea of the proof is to consider a control problem where we fix a refer- 
ence measure and perturb the state process, as opposed to fixing the state variable 
and modulating the measure. To this end, fix a canonical space (£1, J-, (J~t)te[o,T]^^) 
with reference probability measure M and an M-Brownian motion W, and consider the 
perturbed process 

dX\ = a e t dt + b\{dW t + ecp t dt). 

Here, we write X £ to emphasise the dependence on e. The parameters a e , b e are adapted 
functionals of the paths of X € , and hence of the Brownian paths. For e = 0, we have a 
process X° following 



dX" 



a° t dt + b° t dW t . 



The control problem is then written as one over the fixed measure 
<p the objective function 



to maximise over 



2 



Wtfdt 



where, as before, F e denotes a functional of X £ , for e£t. 

We now use Lemma |2. II to differentiate E M [i ?€ ] with respect to e at e = 0. Then the 
objective function of the control problem is approximated as 



(3.7) E R 



F-- 1 - 

2 



T 



m\ 



'dt 



E 



F° + eF\yW) T -\ f 
1 Jo 



m\ 



dt 



+ o(e), 



where o(e) denotes terms of smaller order than linear in e. 

One now invokes the Kunita-Watanabe decomposition of F° under M, which in the 
original set-up corresponds to taking e = in (|3.5p . so in this context reads as 

(3.8) 



F° = E M [F°] + (9° ■ S) T + (e° • W) T , 



for adapted processes # ,£ such that (6° ■ S) and (£° • W) are orthogonal martingales. 
We also have the analogue of (|3.4j) with e = 0, which in this context says that for all 
controls tp, (9° ■ S) and (<p ■ W) are orthogonal M martingales, so we have 



(3.9) 



E M [((?° • S) T (<p ■ W) T ] = 0. 



Using the Kunita-Watanabe decomposition (|3.8j) we substitute for F° in the linear (in 
e) term in (|3.7p . and use (|3.9p and the martingale property of ((p ■ W). This gives 



E 



F ( 



\<Pt\\ &b 



E 



F° + 



T 



1 



We maximise the right-hand-side over 93 by choosing (p 
control problem has asymptotic value given by 



2 



<Pt\ 



dt 



+ o(e). 



This yields that the 



E M [F C 



+ — e 2 E R 
2 



116 



0112 dt 



+ 0{e% 



with the correction term being of order e due to Lemma 12.31 This is the result we 
want, since the dynamics of X° under M match the Q(0)-dynamics of the original state 
process X in (|3.3j) . 

□ 
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4. Dynamic dual representations of indifference price processes 

In this section we derive a dynamic dual stochastic control representation for the 
exponential indifference price process of a European claim in a locally bounded semi- 
martingale market. This will form the basis for our asymptotic expansion of the indiffer- 
ence price. Our representation is a slight deviation from the usual way of expressing the 
indifference price in terms of relative entropy. Although the material in this section is 
mainly classical, we want a unified treatment that gives dynamic results for unbounded 
claims, and this is not readily available in one compact account. 

Our approach is to begin with the seminal representation of Grandits and Rheinlander 
[14| and Kabanov and Strieker [18] for an entropy-minimising measure, to establish a 
dynamic version of this (Corollary 14. 4p . and to use this to establish a dynamic version 
(Theorem I4.5p of the duality result of Delbaen et al [5]. This result has been obtained 
for a bounded claim by Mania and Schweizer [23] . We carry out this program for a 
claim satisfying exponential moment conditions akin to those in Becherer [2]. Once 
we establish duality for the investment problem with random endowment, we obtain a 
dynamic version of the classical dual indifference price representation (Corollary 14. 6|) . 
Then we derive a dynamic result on the entropic distance between measures (Proposition 
14. 7p using the results of |14[ [18] once more, and this allows us to convert the classical 
indifference price representation to our required representation in Lemma 14.81 

The setting is a probability space (Q, J 7 , P) equipped with a filtration F = (J^)o<t<r 
satisfying the usual conditions of right-continuity and completeness, where T G (0, oo) 
is a fixed time horizon. We assume that J-q is trivial and that T = Tt- 

The discounted prices of d stocks are modelled by a positive locally bounded semi- 
martingale S. Since we work with discounted assets, our formulae are unencumbered 
by any interest rate adjustments. The class M of equivalent local martingale measures 
(ELMMs) Q is of course defined by 

M := {Q ~ P|S is a Q-local martingale}, 

and is assumed non-empty. This assumption is a classical one, consistent with the 
absence of arbitrage opportunities, in accordance with Delbaen and Schachermayer [9]. 

Denote by the density process with respect to P of any Q G M. We write Z^' M 
for the density process of Q G M with respect to any measure M other than the physical 
measure P. 

For < t < T, we write Z® T := Zjt/Z^, with a similar convention for any positive 
process. The conditional relative entropy between QgM and P is the process defined 
by 

(4.1) J t (Q|P) := E Q [log Z® T \T t ], < t < T, 

provided this is almost surely finite. Define the subset of M given by 

M f := {Q G M|/ (Q|P) < oo}, 

and we assume throughout that this set of ELMMs with finite relative entropy is non- 
empty: Mj ^ 0. By Theorem 2.1 of Frittelli [13], this implies that there exists a unique 
Q° G Mf, the minimal entropy martingale measure (MEMM), that minimises Io(Q|P) 
over all Q G . It is well-known (for example, Proposition 4.1 of Kabanov and Strieker 
[18] ) that the density process Z^° also minimises the conditional relative entropy process 
I(Q\P) between Q G M f and P. 

The density process of one martingale measure with respect to another is simply the 
ratio of their density processes with respect to P, as shown in the following lemma. 
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Lemma 4.1. LetQi,<Q>2 £ M/ have density processes Z®\Z® 2 with respect to P. Then 
the density process o/Qi with respect to Q2 is Z^ 1 jZ^- 2 . 

Proof. Denote by Z 1 ^ 1 ^ 2 the density process of Qi with respect to <Q>2- We have 

z Qi,^2 ._ dQi _ dQi / 
T '~ dQ 2 ~~ dP 

Hence, the Q2-martingale Z® 1 '® 2 is given by 



dP 



7V1 

Zjrp 
Zjrp 



E^ 2 

1 

Z ®2 



' 7Q1 

Zjp 






Zjp 



E[Z^|Ji] 



Z^ 2 ' 



< i < T, 



the penultimate equality following from the Bayes rule applied between Q2 and P, and 
the final equality from the fact that Z^ 1 is a P-martingale. 

□ 

A financial agent trades S and has risk preferences represented by the exponential 
utility function 

U(x) = — exp(— ax), a > 0, 
with risk aversion coefficient a. A European contingent claim has J-r-measurable payoff 
F. Following Becherer [2] and others, we assume that F satisfies suitable exponential 
moment conditions: 

(4.2) E[exp((a + e)F)] < 00, E[exp(-eF)] < 00, for some e > 0. 

Condition (|4.2p is sufficient to guarantee that F is Q-integrable for any Q € Mj (see 
for example Lemma A.l in Becherer [2]). 

4.1. The dynamic primal and dual problems. The set of admissible trading 
strategies is defined as the set of S'-integrable processes 9 such that the stochastic integral 
9 ■ S is a Q-martingale for every Q £ M t , where 9 is a <i-dimensional vector representing 
the number of shares of each stock in the vector S. It is well-known [21 [HJ [181 ETJ 132] 
that there are a number of possible choices for a feasible set of permitted strategies, 
which all lead to the same value for the dual problem, defined further below, and it is 
on this latter problem that our analysis will be centred on. For any t € [0,T], fix an 
J-t-measurable random variable xt, representing initial capital. Let Qt denote admissible 
strategies beginning at t. 

The primal problem is to maximise expected utility of terminal wealth generated from 
trading S and paying the claim payoff at T. The maximal expected utility process is 



(4.3) 



u: 



ess sup E 

0G0t 



-a(x t +/ t T du-dSu-F) 



0<t<T, 



with jfV dS u = ZtiJt u dS l 

We shall use the notational convention whereby setting F = in (|4.3|) signifies the 
corresponding quantity in the problem without the claim. Hence, the classical invest- 
ment problem without the claim has maximal expected utility process u . Denote the 
optimiser in (|4.3p by 9 F , so 9° is the optimiser in the problem without the claim. 
The utility indifference price process for the claim, p(a), is defined by 

(4.4) uf (x t + Pt(a)) = u° t {x t ), < t < T. 



12 



MICHAEL MONOYIOS 



It is well-known that p(a) has no dependence on the starting capital. The hedging 
strategy associated with this pricing mechanism is 0(a), defined by 

(4.5) 9(a) :=8 F -6°. 

The dual problem to (|4.3|) is defined by 



(4.6) 



ess inf 

QeM f L 



Ii 



aE Q [F\F t 



0<t<T. 



Denote the optimiser in (|4.6p by Q , so the optimiser without the claim is ( 
MEMM. 

It is well-known (at least in a static context) that if we define the measure Fp 



the 

"by 



(4.7) 



dF F exp(aF) 



dP ' E[exp(<xF)]' 



then we can use Pi? instead of P as our reference measure, and this removes the claim 
from the primal and dual problems. In the dual picture, therefore, Q F is the martingale 
measure which minimises the relative entropy between any Q € and ¥p. These 
properties of P^ are well-known in a static context from Delbaen et al [8]. The dynamic 
analogue of these arguments is given below. 

Note that if we use P F instead of P as reference measure, one could (in principle) 
define a set Mj(P^) of ELMMs with finite relative entropy with respect to ¥p, but it 
is well-known that Mj(Pp) = Mj(P) (see the statement and proof of Lemma A.l in 
Becherer [2], for example) so we simply write My. 

Define the P-martingale M F as the density process of P^ with respect to P: 



Ml 



dP F 



dP 



E 



dP F 



dP 



ne aF \T t ] 
E\e aF ] 



< t < T, 



which satisfies, for any integrable J-y-measurable random variable V, 
(4.8) E^FlJi] = j^EiM^VlTt], 0<t<T. 

We "remove the claim" from the primal problem using the measure P^ as follows. Using 
we convert (|4.3p to 



< (x t ) := E[e ar \T t ] ess sup E f 

£»GG f 



*(xt+Jt 8 U -AS U ) 



0<t<T, 



from which it is apparent that one may optimise over strategies in a problem without the 
claim and with P^ as reference measure. The same approach also works, of course, for 
the dual problem, as we show below. We shall need the following simple result relating 
the density process of any Q £ Mj with respect to P to its counterpart with respect to 



Lemma 4.2. For any Q € Mj, the density processes Z 1 ^ and Z^ F are related by 



Z^ = M f Z^ Pf , 0<t<T. 
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E 



If 



dl 



1 

zl 



dP F 



Mf dl 



dP 



E 



dP 
< t < T, 



where we have used 

Applying Lemma 
(4.9) 



□ 



in turn at t < T and at T, we obtain 

, Pf Z® T E[e<* F \T t ] 



J t,T 



aF Z^ T , 0<t<T. 



We use this to "remove the claim" from the dual problem (|4.6p : compute, for any 
Q E My, 

It(Q F \W F ) = E^[log Zf m 



\F, 



aE v [F\F t ] + log(E[e aF |J- t ]), < t < T. 



= /t(Q|i 

Using this in f)4.6[) . we obtain 

(4.10) if = essinf[/ t (Q|P F )] - log(E[e aF |J- t ]), < t < T. 

Qgm f 

Since the last term on the right-hand-side does not depend on Q, we see that we can 
reduce the dual problem to the problem 



It 



mm!, 



so that Q F minimises /(Q|P F ), and, when F = 0, Q° is the MEMM. 

4.2. The fundamental duality. The duality results we need follow from the represen- 
tation below for ^ F , originally proven independently (to the best of our knowledge) 
by Grandits and Rheinlander |14] and Kabanov and Strieker [18] for F = (and hence 
for Z^ ), but which applies equally well to Q F if we use P^ as reference measure. Both 
|14j and |18j prove the result for a market involving a locally bounded semi-martingale 
S. This has been generalised to a general semi-martingale by Biagini and Fritelli [1]. 

Property 4.3 (|14l I18j). The density of the dual minimis er Q F in h4.6\ ) with respect to 
the measure ¥p defined in J^. 7[ ) is given by 

(4.11) 4S- = Z f' ¥F = C F exp(-a(# F • S) T ), c f € R+, 



dP F 



where 9 F € is the optimal strategy in the primal problem |^.3[ ) and the stochastic 
integral (0 F ■ S) is a Q-martingale for any Q G Mj. 

We convert this to the dynamic result below, in which we also restore P as reference 
measure. 
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Corollary 4.4. The density process 
forte[0,T], 



of the dual minimiser 



in 



satisfies, 



(4.12) 



t.T 



exp 



a E Q [F\F t ] + / Of ■ dS u — F 



where 9 F € is the optimal strategy in the primal problem 

Proof. First, we obtain a dynamic version of (|4.1ip . Using (|4.1ip and the Q J 
property of (9 F ■ S), we have 

I t (Q F \F F ) = E^ F [logZ^\F t ] 

= EO'pogc* - a(9 F ■ S) T \F t ] - logzf > P - 
= logc F - a(6 F ■ S) t - log Z® F ' ¥f , 0<t<T. 
Using this in turn at t < T and T we obtain 



-martingale 



Z® T ,Pf = cf exp 



-a 



dS u 



exp (7 t 



< t < T, 



which is a dynamic version of (|4,11|) . Using this along with (|4,9p and (|4.10p we obtain 



exp I, 



dS u + aF 



< t < T. 



Finally, using the definition (|4.6p of I gives the result. 



□ 



Corollary S3] is nothing more than a dynamic version of the classical result of Grandits 
and Rheinlander [13] and Kabanov and Strieker [18] for the MEMM, with the added 
generalisation of allowing for Fp as reference measure. It leads immediately to the 
duality result below, a dynamic version of the duality in Delbaen et al [S]. This result 
is stated in Mania and Schweizer [23] for a bounded claim. We give a proof to highlight 
that the boundedness condition on the claim is not needed. 

Theorem 4.5 ([5] [2] [T5] 123]). Suppose the claim payoff F satisfies the exponential 
moment conditions j^.£| ). Then the maximal expected utility process in J^.^[ ) and the 
optimal dual process in J4-6p are related by 

uf(x t ) = — exp (—axt — if) , < t < T. 



(4.13) 



Proof. We compute the primal optimal expected utility process and use Corollary 
to substitute for the stochastic integral (8 F ■ S): 

- a ( Xt +f t T 9 F-dS u -F) 



u t (x t ) 



E 



Ft 



-e~ aXt E[Z® T exp(-/f)|Ji] (using Corollary 
- exp (-ax t -If), < t < T. 



□ 



Using this theorem and the definition of the indifference price we obtain the following 
dual representation of the indifference price process, a dynamic version of the classical 
representation. 
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(4.14) 



Pt(a) 



1 



a 



(If ~ A 



< t < T. 



Written out explicitly, (|4.14|) can be re-cast into the more familiar form 

1 



(4.15) Pt(ct) = ess sup 



E^[F\T t 



It 



It(Q° 



a 



< t < T. 



The two conditional entropy terms in (|4.15p can in fact be condensed into one, using 
the following proposition. 

Proposition 4.7. The conditional entropy process I satisfies the property that, for any 
equivalent local martingale measure Q € M/, 



(4.16) J t (Q|P) -/ 4 (Q U |P) = Ii(Q|Q u ), 0<t<T. 

Proof For any Q € Mj, the conditional entropy process I(Q|Q°) is given by 

7 t (Q|Q°) := E®[logZ®f\T t ) 

= E^[log 2$ T - log Z$\T t ] 

(4.17) = I t (Q\F)-E Q [logZ^\F t ], < t < T. 



We have the dynamic version of the Grandits-Rheinlander [J2] representation of the 
MEMM, given by KT2\\ for F = 0: 



Zfj, = exp I Ii 



aj\° u -dS u }, 0<t<T, 



where the optimal investment strategy 9° G 0, so (9° ■ S) is a Q-martingale, for any 
Q€Mf. Using this in (jlT?) we obtain ([iTTHjl . 

□ 



Using Proposition 14.71 in the classical dual stochastic control representation (|4.14p of 
the indifference price process, we immediately obtain the following form for p(a), which 
will form the basis for our asymptotic expansion of the indifference price process. 

Lemma 4.8. The indifference price process is given by the dual stochastic control rep- 
resentation 



Pt(ct) = ess sup 
Proof Use (jlTTBD in flUD) . 



F\F t ] - -I t 
a 



< t < T. 



□ 



Remark 4.9. A version of Lemma 14.81 for American claims was given in Leung et al [22 
in a stochastic volatility scenario (see their Theorem 8). 



Remark 4.10. The optimiser in Lemma 14.81 is also the optimiser in ()4.15p . that is, Q F . 
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5. Indifference valuation in an incomplete Ito process market 

In this section we apply the indifference pricing formula from Lemma 14.81 in an Ito 
process setting, and we show how it leads to a control problem of the form in Section [3l 

We have a probability space (fi, J 7 , P) equipped with the standard augmented filtration 
F := (J-t)o<t<T associated with an m-dimensional Brownian motion W. On this space 
we have a financial market with (for simplicity) zero interest rate. The price processes 
of d < m stocks are given by the vector S = (S 1 , . . . , S d )*, where S = (St)o<t<T follows 
the Ito process 

(5.1) dS t = diag^) [/if dt + a t dW t ], 

with diag^(-) denoting the (d x d) matrix with zero entries off the main diagonal. The 
d-dimensional appreciation rate vector fi s and the (d x m) volatility matrix a are F- 
progressively measurable processes, satisfying f Q ||//f||di < oo and J Q ata* dt < oo, 
almost surely. The volatility matrix at has full rank for every t £ [0, T], so that the 
matrix (ata\ ) _1 is well-defined, as is the m-dimensional relative risk process given by 

(5.2) A t :=a t > t a*rVf, < t < T. 

For d < m, this market is incomplete. We also have a vector Y = (Y 1 , . . . ^Y m ~ d )* 
of (m — d) non-traded factors. These could be the prices of non-traded assets, or of 
factors such as stochastic volatilities and correlations. This framework is general enough 
to encompass multi-dimensional versions of basis risk models as well as multi-factor 
stochastic volatility models, with no Markovian structure needed. We assume that Y 
follows the Ito process 

dY t = di&g m _ d {Y t )[tf dt + fa dW t ], 

for an (m — d)-dimensional progressively measurable vector fjX satisfying \\nYW dt < 
oo, almost surely, and an (m — d) X m-dimensional progressively measurable matrix (3 
satisfying J Q /3 t( 3 t * dt < oo, almost surely. 

A European contingent claim has J^-measurable payoff F depending on the evolution 
of (S,Y). We assume F G L 2 (Q), for any ELMM Q € M f . 

Measures Q ~ P have density processes with respect to P of the form 

(5.3) Zf = 8{-q ■ W) t , 0<t<T, 

for some ?n-dimensional process q satisfying \\qt\\ 2 dt < oo almost surely. If Z^ is 
the density of an equivalent local martingale measure, then it is a P-martingale, and q 
satisfies 

(5.4) M f - afq t = d , < t < T, 

where 0^ denotes the c?-dimensional zero vector. As the market is incomplete, there will 
be an infinite number of solutions q to the equations (|5.4p . and the ELMMs Q are in 
one-to-one correspondence with processes q satisfying (|5.4p and such that £{—q ■ W) is 
a P-martingale. Denote by Q(M/) the set of integrands q in (|5.3p which correspond to 
Q G M f . 

By the Girsanov theorem, the process W 1 ^ defined by 

(5.5) := W t + f q u du, 0<t< T, 

Jo 
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is an m-dimensional Q-Brownian motion. The dynamics of the stocks and non-traded 
factors under Q are then 

(5.6) dS t = dmg d (S t )a? dW? , 

(5.7) dY t = di agm _ d (Y t )[(tf -Ptqt)dt + /3 t dW®]. 

If we choose q = A, given by (|5.2p . we obtain the minimal martingale measure Qm ? while 
the density process of the MEMM Q° is = S(—q° ■ W), for some integrand q°. 

Denote by H 2 (Q) the space of L 2 -bounded continuous Q-martingales M (that is, 
su Pte[o,T] E Q [M t 2 ] < oo), and by H$(Q) the subset of elements of H 2 (Q) null at zero. 
By Proposition IV. 1.23 and Corollary IV. 1.25 in Revuz and Yor [30] . H 2 (Q) is also the 
space of martingales M such that E^[[M]x] < oo. 

Denoting := [q ■ W Q ), then using (OJ) and (|53j> . logZ^ = -A® + [A Q ]/2, so the 
relative entropy between Q £ Mj and F is given by 



< J (Q|P) = E 4 - 



-a? + 1[aQ] t 



< oo, 



the last inequality true by assumption. The finiteness and non-negativity of this relative 
entropy yields that both expectations above are finite. Precisely, we have E^[Aj!] > -co 
and, in particular, E ( ^[[A ( ^]r] < oo, the latter condition implying that A 1 ^ £ H 2 ' 
Therefore, 

(5.8) A Q := (q ■ W Q ) is a Q-martingale, for all Q € M f . 

This will be useful in computing the conditional relative entropy J(Q|Q°). 
Using (|5.5p in turn for Q and Q°, we have 

(5.9) = Wf + (q t - q° t ) dt, < t < T, 

Jo 



where W 11 ^ is a Q°-Brownian motion. 

Note that since both q and q° satisfy (|5.4p . we have 

(5.10) a t (q t - q°) = d , < t < T, 

which we shall use later. 

Using (|5.9p . we can write the Q-dynamics of Y in (|5.7p as 

dY t = diag m _ d (y t )[(/xf - dt + f3 t (dW® - (q t - g°) dt)]. 

The point of this representation is that the Q-dynamics of Y may be interpreted as a 
perturbation of the Q°-dynamics, since setting q = q° gives the dynamics under the 
MEMM Q°, with the Brownian motion also being modulated by the choice of q. 
Using (|5.5p and (|5.9p . the density process of Q with respect to Q° is 

Z?,Q ° = $ = %$%k = e{ ~ {q ~ q " ] ■ wV% - ' - T ' 

Using this, along with ()5.9[) and the martingale condition (|5.8p . we compute 

1 



(5.11) /t(Q|Q u ) = E^ 



2 



T 

II 2 



\q u -q u \\ du 



0<t<T. 



Now we explicitly consider Q as a perturbation around Q°. Introduce, for some small 
parameter e, a parametrised family of measures {Q(e)} e giR, such that 

(5.12) Q = Q(e), Q°e 
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and also write 

(5.13) q-q°=:-e<p, 
for some process <p. Then (|5.10p becomes 

(5.14) a<p = d . 

Denote by $(M/) the set of such <p which correspond to Q € M/, and also define the 
process $ := J Q ip s ds. 

The Q(e)-dynamics of the state variables S, Y in this notation are then 

(5.15) dS t = di agd (S t )a t dW® {e \ 

(5.16) dY t = diag m _ d (F t )[(/ir-Ag?)dt + A(dW t Q(e) + e ^)]. 

Observe that if we define the state variable X := (S,Y)*, then we have recovered 
dynamics of the general form (|3.2p . 

The Q(e)-dynamics (|5.15p of S, along with the constraint (|5.14p . lead to the following 
orthogonality result. 

Lemma 5.1. Consider integrands 9 e ,f such that (6 e ■ S) is a Q(e) -martingale and ip 
satisfies \5.14\j . Then the stochastic integrals (9 e ■ S) and (tp ■ W®^) are orthogonal 
Q(e)- martingales. That is, 

E®&[(e e • 5)t(<^ • ^ q(£) )t] = 0. 
Proof. This is a straightforward computation using (|5.15p and f|5. 14j) . 

□ 

Remark 5.2. Notice that this is precisely the statement of Property 13.11 that was used 
in the proof of the abstract asymptotic expansion of Theorem 13.21 



Now let F be an J^-measurable square-integrable functional of the paths of S, Y, and 
hence of the Brownian paths, representing the payoff of a European contingent claim. 
When the dynamics of the state variables are given as in (|5.15p and (j5. 16|) . we write 
F(W®( e ) +e$) = F e . Write the Galtchouk-Kunita-Watanabe decomposition of F e under 

Q(e) as 

(5.17) F e = K Q ^[F e ] + (6 e ■ S) T + (f ■ W Q{e) ) T , 

for some integrands 6 e ,^ e , such that the stochastic integrals in (|5.17p are orthogonal 
Q(e)-martingales, so we have 

E Q{e) [(9 e -S) T (e -W Q{e) ) T } =0. 

On using (|5.11[) and (j5. 13|) . the indifference price process, as given by Lemma l4^8| then 
has the stochastic control representation 



2a 



pt(a) = sup E Q W 
If we choose 

(5.18) e 2 = a 
then we get a control problem of the form 

(5.19) pt(a) = sup F e -\ 



0<t<T. 



F e ~=: I hufdu 



0<t<T. 
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subject to Q(e)-dynamics of S, Y given by (|5.15|) . (|5.16|) . and with Q(0) corresponding 
to the MEMM Q°. We have now formulated the indifference pricing control problem in 
the form of the control problem described in Section [3j and applying Theorem 13. 2\ we 
have the following result. 

Theorem 5.3. Let the payoff of the claim, F, be a square- integrable functional of the 
paths of S,Y, having Q(e)- dynamics I\5.15i5.1b}) , with Q(e) given by \5.12\) , and with 
the parameter e given by \5.18\) . Then for small risk aversion a, the indifference price 
process of the claim has the asymptotic expansion 

rT 



(5.20) Pt (a) = E^ 



[F\F t ] + iaE«° 



+ 0(a), 0<t<T, 



where Q° is the minimal entropy martingale measure, and £° is the process in the Kunita- 
Watanabe decomposition J5. 17\ ) of the claim, under < rt " 



Proof. This is a direct application of Theorem 13.21 to the stochastic control problem 
(EHJ). 

□ 



The underlying message of Theorem 15 .31 is that for small risk aversion, the lowest order 
contribution to the indifference price process is the marginal utility-based price process 
Pt := E^ [FlJ^], corresponding to the valuation methodology developed by Davis [6]. 
The first order correction is a mean-variance correction, since the Kunita-Watanabe 
decomposition ()5.17p for e = is the Follmer-Schweizer-Sondermann decomposition of 
the claim under Q°, and the integrand 9° in (|5.17p is a risk-minimising strategy in the 
sense of Follmer and Sondermann [TU] under Q°. Similar results have been obtained for 
bounded claims by Mania and Schweizer [23] and Kallsen and Rheinlander |20j. The 
contribution here is to show a new methodology for obtaining this result, for a square- 
integrable claim. The strategy 9° is, in general, the zero risk aversion limit of the optimal 
hedging strategy 6(a) (see, for example, [231 ED] for a bounded claim), and hence can 
also be interpreted as the marginal utility-based hedging strategy. 

Note that using (|5.17p for e = 0, we can write (|5.20p as 



E^[F\T t _ 



+ 



1 

r 



vax® u [F\T t ] -E< 



0° u \\ 2 d[S] u 



+ 0(a 2 ), 



for t € [0,T], which highlights the mean- variance structure of the asymptotic represen- 
tation. 



6. Applications 

Here we show some examples where Theorem 15.31 would apply. 

Example 6.1 (Multi-dimensional basis risk model). This is the model of Section [51 with 
d traded stocks S and (m — d) non-traded assets Y, and with the volatility process a in 
(|5,ip given by 

o-t = ( °t Odx(m-d) ) , < t < T, 
where Qdx{m-d) denotes the zero dx (m — d) matrix. Write the m-dimensional Brownian 
motion W as W = (W s , W s,± )*, where W s denotes the first d components of W . Then 
the d traded stocks are driven by d Brownian motions, and the non-traded assets are 
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imperfectly correlated with S. The claim payoff F is typically dependent on the evolution 
of Y only, though our results are valid without this restriction. 

In this case, the process A in (|5.2p and the integrand q in (|5.3p are given by 



A, 



Af 



0, 



It 



A? 
It 



0<t<T, 



where X s is the stock's d-dimensional market price of risk process, given by A 5 := 
a (a a )~ 1 /j s , and 7 is an (m — <i)-dimensional adapted process. Each choice of 7 
leads to a different ELMM Q, with 7 = 0, 



, with 7 = m -d corresponding to the minimal martingale 
measure Qm- Then the density process of any ELMM Q € is given by 



-X s ■ w s 



1-W b ^) t , 0<t<T. 



A special feature of these models arises when the process X s is either deterministic or 
does not depend on the non-traded asset prices Y. In this case it is not hard to see that 
}m- This is because the relative entropy process between Q G M f 



the MEMM Q° = 
and P is given by 



(6.1) 



A«|| 2 + ||7uf )du 



Tt 



0<t<T. 



dY t = di&g m _ d {Y t ) 



/if- A 



dt + dWl 



The problem of finding the minimal entropy martingale measure is then to minimise 
this functional subject to Q-dynamics of S, Y given by (|5.6l5.7p . The process 7 plays 
the role of a control. In the current notation, the Q-dynamics of Y are given as 

From this it is clear that if A does not depend on Y, then it is unaffected by the control, 
and then the relative entropy process in (|6.ip is minimised by choosing 7 = m -d, so 
Qe = Q° = Qm- In this case, the Kunita-Watanabe decomposition of the claim under 
Q M will be of the form 

(6.2) F = E QM [F] + (9 M ■ S) T + (£ M • W Qm ) t , 

for integrands 6 M ,£ M such that the Q A f-martingales (6 M ■ S) and (£ M • W Qm ) are 
orthogonal, and W^ M is a Qjvf-Brownian motion. An example where this pertains is 
given in Monoyios [28], in a two-dimensional model of basis risk with partial information. 
The indifference price expansion at time zero is then given as 



(6.3) p (a) = E< 



' M [F]+ l -a 



var^ M [F] — ES 



t 



d[S\ t 



+ 0(a 2 



When the model is Markovian, the integrand 9 M can sometimes be expressed in terms of 
the partial derivatives with respect to S and Y of the marginal price process p(t, St, Y t ) = 
E<*u[F\St,Yt]. 

Example 6.2 (Lognormal basis risk model). This is the classical example first considered 
by Davis [7], and is a special case of Example 16. 1\ with constant parameters, so once 
again we will have Q° = Q M . Here we show how the asymptotic expansion for the 
indifference price simplifies in this case, and so we extend results of Davis and others 
[3 [151 121] to general (and so possibly path-dependent) payoffs dependent on the non- 
traded asset price. 
Set d = 1, m 

Y 



2 in Example 16. 1\ and set fi s , fi Y , a s , /3 to be constant, with 



3 



a 



VT 7 ?). pe(-i,i) 
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for constants a Y , p. Then the stock and non-traded asset are imperfectly correlated with 
cross-variation process given by 



[S, Y] t = pa s a Y [ S U Y U du, < t < T. 
Jo 



The P-dynamics of the assets are 

dS t = <r S S t {X s dt + dWf), dY t = Y t (p Y dt + a Y dWf ), X s := p s /a s , 



where W Y = pW s + yl — p 2 W s, - L . It is easy to see that in this case Q° = Qm, under 
which the dynamics of the asset prices are 

(6.4) dS t = a s S t dW t SMM , dY t = Y t [(p Y - p\ S a Y ) dt + a Y dW? Mu ] , 

for Q^.j-Brownian motions W ^ M ,W Y '^ M with instantaneous correlation p, so that 

(6.5) W Y ® M = P W S ^> + ^T^W 3 ^' , 

with W S '^ M , W S ' ± '' I ^ M independent (Q>M-Brownian motions. 

Suppose that the claim payoff F depends only on the evolution of Y (but can indeed 
be path-dependent). Then the Kunita-Watanabe decomposition of F under Q A/ will be 
of the special form 

(6.6) F = E q * i [F] + (iIj-W y > Qm ) t , 

for some process tp such that (^ ■ W Y,t ^ M ) is a Q M -martingale. But we also have the 
general form of this decomposition, given by the analogue of (|6.2|) . which in this case 
reads as 

(6.7) F = E Qm [F] + {6 M ■ S) T + (£ M • W s ' L ' Qm ) t , 

for integrands M ,£ M (here, M would be the marginal utility-based hedging strategy, 
or equivalently, the risk- minimising strategy for the claim). 

Equating the representations in (|6.6|) and (|6.7|) and in view of (|6.4|) and (|6.5|) . it is 
easy to see that 6 M ,^ M are both linearly related to the process if), through 



M a s S = (njj, e M = \/l - P 2 i>- 
It is then straightforward to compute that 



var Qw [F] = ^E Qm 
p 2 



[ T (0ffd[S] t 
Jo 



The time-zero indifference price expansion ([6.3p in this case then simplifies to 

p (a) = E^'[F] + ^a(l - p 2 )var Q «[F] + 0(a 2 ), 

which is an extension of the form found in [T5| [24"] to general square-integrable Euro- 
pean payoffs. 

Example 6.3 (Basis risk with stochastic correlation). This model has been considered by 
Ankirchner and Heyne [TJ, who examined local risk minimisation methods for hedging 
basis risk. A traded asset S and non-traded asset Y follow correlated geometric Brownian 
motions, as in Example 16.21 but the correlation p = (pt)o<t<T is now stochastic. In this 
case, we have m = 3, d = 1, and with W a three-dimensional Brownian motion, let 
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W S = W Y = pW l + y / 1 _ p 2 W 2^ W p = 5W 1 + ^ W 2 + y / 1 _ §2 _ r? 2 VF 3 ) for 

constants 5, r\ such that 5 2 + rj 2 < 1. The state variable dynamics are then 

dS t = a s S t (X s dt + dW t l ), 

dY t = Y t [p Y dt + a Y ( Pt dWl + y/l - P 2 dW 2 )}, 

d Pt = g t dt + h t (5 dW t l + 77 dW? + y / l-5 2 -r ] 2 dW t 3 ) . 

Here, g,h are adapted processes such that pt € [—1,1] almost surely. Ankirchner and 
Heyne [1] give some specific examples of such models. 

In this example we also have Q° = Qm, with Z^ M = £(— X s W l ), and the Follmer- 
Schweizer-Sondermann decomposition of the claim is of the form 

(6.8) F = E^ M [F] + (9 M ■ S) T + (£ M ■ W 2 ' Qm ) t + (<p M ■ W 3 ' Qm ) t , 

for some integrands 6 M ,£ M ,(j) M , and where W Qm = (W 1 ®* 1 , W 2 ^ M , W 3 ' Qm )* is a 
three-dimensional Q^-Brownian motion, the first of which drives the stock, so that the 
stochastic integrals in (|6.8p are orthogonal Q^.y-martingales. The time-zero indifference 
price expansion is again of the form (|6.3p . 

Many other examples are covered by the framework of Theorem l5.3l including classical 
stochastic volatility models, which are similar in some ways to the two-dimensional basis 
risk models, and basis risk models with stochastic volatility (so m = 3. d = 1) with 
a traded and non-traded asset both driven by a common stochastic volatility process 
(and stochastic correlation can be added to this framework). An interesting case would 
be an extension of the model considered in [2H], a basis risk model with unknown asset 
drifts. In j28] the unknown drifts are modelled as unknown constants, and hence as 
random variables with a prior distribution, which is updated via a Kalman filter. It 
would be interesting to model the drifts as linear diffusions, which would result in a 
random parameter basis risk model. 



6.1. Entropy minimisation in stochastic volatility models. We end with another 
application of the asymptotic methods developed in the paper. This time, we are in- 
terested in finding the minimal entropy martingale measure Q° = Qe in a stochastic 
volatility model. A traded asset S and a non-traded stochastic factor Y follow, under 
the physical measure P, 



(6.9) 
(6.10) 



dS t 
dY t 



a(Y t )S t (X(Y t )dt+ dWf), 
a(Y t )dt + b(Y t )dW Y , 



for suitable functions a, A, a, b such that there are unique strong solutions to (|6.9l6.10p . 
The Brownian motions W s , W have constant correlation p € [—1,1]. We write Wj = 
pWf + v 7 ! - p 2 Wt' L . The density process of any ELMM Q is 



= £(-X ■ W b - 7 • W b '^) t , 0<t<T, 

for some square-integrable process 7 such that Z 1 ^ is a P-martingale. 

The entropy minimisation problem is the stochastic control problem to minimise 



in 



{X 2 {Y t ) +1 2 )dt 
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over control processes 7, where we assume that Io(Q|P) < °°j an d where, under Q, S,Y 
follow 

dS t = a(Y t )S t dW t SM , 



(6.11) dY t = (a(Y t ) - b(Y t )p\(Y t ))dt + b(Y t )(dW?' Q -y/l- p 2 ltdt), 

for Q-Brownian motions W S '^, W Y '^ with correlation p, such that setting 7 = yields 
the minimal martingale measure Qm- 

The idea here is to consider the drift adjustment yl — p 2 ^t in (|6.11|) as a perturbation 
to the Brownian paths, and hence to convert the entropy minimisation problem to the 
type of control problem we have considered in Section O in the limit that the absolute 
value of the correlation is close to 1, so 1 — p 2 is small. To this end, we define a parameter 
e and a control process ip such that 



e 2 = l-p 2 , e<p = -VI - p 2 7, 
and we define a parametrised family of measures {Q(e)} eG R, such that 

Q = Q(e), Q(0) = Q M - 
The state variable dynamics for Y are then given by 

(6.12) dY t = (a(Y t ) - b{Y t )p\{Y t )) dt + b{Y t ){ dW^ Q(e) + e<p t dt). 

With $ := J ip s ds, we define a square-integrable functional F e = F(W^ e ^ + e<3>) of the 
Brownian paths by 

rT 



F e :=lJ Q X\Y t )dt=:\K T , 



where, for brevity of notation, we have defined the so-called mean-variance trade-off 
process K by 

(6.13) K t := I X 2 (Y u )du, 0<t<T. 

Jo 

In this notation, the relative entropy between the minimal martingale measure and P is 

1 



(6.14) Jo(Qm|P) = E< 



K T 
2 



E Q(0)^0]_ 



The control problem to minimise /q(Q|P) over ELMMs QsMj has value function 



1 



T 



(6.15) /o(Qe|P) := mf 

where <J>(M^) denotes the set of controls ip such that ^(QIP) is finite. 

We have now formulated the entropy minimisation problem in the form we need to 
be able to apply the Malliavin asymptotic method, and this gives the theorem below. 

Theorem 6.4. In the stochastic volatility model defined by i6.9i6.10\) . the relative en- 
tropy between the minimal entropy martingale measure Qe andW, in the limit that 1 — p 2 
is close to 1, is given as 

1 



/o(Qm|P) - o(l - p')vaiVM[K T ] + Q((l 



where Qm is the minimal martingale measure and K is the mean-variance trade-off 
process defined in \6.13\) . 
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Proof. This is along the same lines as previous results, so we only sketch the details. 
One appeals to the decomposition of F e under Q(e), which is of the form 

(6.16) F e = [F e ] + (f • W Q{e) ) T , 

for some integrand £ e . Such a decomposition exists uniquely, given that F € depends 
only on Y, and the dynamics in (|6.12|) . In particular, this decomposition also holds for 
e = 0. We expand the objective function (|6.15p about e = and use the representation 
(|6.16|) for e = 0. This gives 



E^ 



1 



F u + ^ (e&pt + \pt ) dt 



+ o(e) 



We minimise the right-hand-side over ip by choosing ip = — e£°. Using (|6.16p at e = 
again, and recalling (|6.14|) . the result follows. 

□ 

Remark 6.5. In [2b\ 125]. Esscher transform relations between and Qm are derived, 
and it is an exercise in asymptotic analysis to see that those results are consistent with 
Theorem 16. 41 

7. Conclusions 

It is quite natural to apply Malliavin calculus ideas in stochastic control problems 
where the control turns out to be a drift which is considered as a perturbation to a 
Brownian motion, and this is the path taken in this paper. We have shown how the 
method can yield small risk aversion asymptotic expansions for exponential indifference 
prices in Ito process models, and how one can identify the minimal entropy measure 
as a perturbation to the minimal martingale measure in stochastic volatility models. It 
would be interesting to extend the method to models with jumps in the underlying state 
process. 
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